Multi-dimensional Resource Allocation in Distributed Data Centers using Deep Reinforcement Learning

نویسندگان

چکیده

With the development of edge-cloud computing technologies, distributed data centers (DCs) have been extensively deployed across global Internet. Since different users/applications heterogeneous requirements on specific types ICT resources in DCs, how to optimize such under dynamic and even uncertain environments becomes a challenging issue. Traditional approaches are not able provide effective solutions for multi-dimensional resource allocation that involves balanced utilization DC environments. This paper presents reinforcement learning based approach (termed as NESRL-MRM) is achieve availability To train NESRL-MRM’s agent with sufficiently quick wall-clock time but without loss exploration diversity search space, natural evolution strategy (NES) employed approximate gradient reward function. realistically evaluate performance NESRL-MRM, our simulation evaluations real-world workload traces from Amazon EC2 Google datacenters. Our results show NESRL-MRM significant improvement over existing balancing resources, which leads substantially reduced blocking probability future incoming demands.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep Reinforcement Learning for Resource Allocation in V2V Communications

In this article, we develop a decentralized resource allocation mechanism for vehicle-to-vehicle (V2V) communication systems based on deep reinforcement learning. Each V2V link is considered as an agent, making its own decisions to find optimal sub-band and power level for transmission. Since the proposed method is decentralized, the global information is not required for each agent to make its...

متن کامل

Online Resource Allocation Using Decompositional Reinforcement Learning

This paper considers a novel application domain for reinforcement learning: that of “autonomic computing,” i.e. selfmanaging computing systems. RL is applied to an online resource allocation task in a distributed multi-application computing environment with independent time-varying load in each application. The task is to allocate servers in real time so as to maximize the sum of performance-ba...

متن کامل

Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The traditional solution is to design efficient heuristic algorithms with performance guarantee under certain assumptions. In this paper, we improve a recently proposed ...

متن کامل

Data Driven Resource Allocation for Distributed Learning

In distributed machine learning, data is dispatched to multiple machines for processing. Motivated by the fact that similar data points often belong to the same or similar classes, and more generally, classification rules of high accuracy tend to be “locally simple but globally complex” [45], we propose data dependent dispatching that takes advantage of such structure. We present an in-depth an...

متن کامل

Dynamic Resource Allocation for Shared Data Centers Using Online Measurements

Since web workloads are known to vary dynamically with time, in this paper, we argue that dynamic resource allocation techniques are necessary to provide guarantees to web applications running on shared data centers. To address this issue, we use a system architecture that combines online measurements with prediction and resource allocation techniques. To perform resource allocation, we model a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Network and Service Management

سال: 2023

ISSN: ['2373-7379', '1932-4537']

DOI: https://doi.org/10.1109/tnsm.2022.3213575